TRACES OF SINGULAR VALUES AND BORCHERDS PRODUCTS 



CHANG HEON KIM 

Abstract. Let p be a prime for which the congruence group To(p)* is of genus zero, and 
j* be the corresponding Hauptmodul. Let / be a nearly holomorphic modular form of 
weight 1/2 on To(4p) which satisfies some congruence condition on its Fourier coefficients. 
We interpret / as a vector valued modular form. Applying Borcherds lifting of vector 
valued modular forms we construct infinite products associated to j* and extend Zagier's 
trace formula for singular values of j* . Further we investigate the twisted traces of sigular 
values of j* and construct Borcherds products related to them. 



1. Introduction 

Let d denote a positive integer congruent to or 3 modulo 4. We denote by Qd the set 
of positive definite binary quadratic forms Q = [a, b, c] = aX 2 + bXY + cY 2 (a, b,c G Z) of 
discriminant —d, with usual action of the modular group T = SX 2 (Z). To each Q G Qd, 
we associate its unique root olq G S) (=upper half plane). Let j(r) (r G Sj) be the elliptic 
modular invariant and t(d) be the (weighted) trace of a singular modulus of discriminant 
~d (= E i£iO'(a<j) - 744 ))- Here f Q = {7 e f = PSL 2 (Z) I Q o 7 = Q}. In 
addition we set t(-l) = — 1, t(0) = 2 and t(d) = for d < -1 or d = 1, 2 (mod 4). 
Zagier showed the series E dgZ t(d)q d (q = e 2nlT , t G ^) is a modular form of weight 3/2 on 
r (4) = {( a c h d ) G SX 2 (Z), 4|c}, holomorphic in ,fj and meromorphic at cusps ([TBI Theorem 
!)• 

Let r (iV)* (N = 1,2,3,... ) be the group generated by r (A r ) and all Atkin-Lehner 
involutions W e for e||iV. Here W e is represented by a matrix of the form ^{ ew) w hh 
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x, y, z, w G Z and xwe — yzN/e = 1. There are only finitely many values of N for which 
T Q (N)* is of genus 0. In particular, if we let & denote the set of prime values for such N, 
then 



Let j* N be the corresponding Hauptmodul, whose Fourier expansion starts with q 1 + + 
a\q + a 2 q 2 + • • ■ ■ It can be described by means of Dedekind eta function or theta functions. 
For example, if N — 1 divides 24, then the Hauptmodul j* N is explicitly given by 



By a result of Borcherds [T| the Fourier coefficients of j* N are related to certain representa- 
tions of the monster simple group. 

Let d be an integer > such that —d is congruent to a square modulo AN . We choose 
an integer j3 (mod 2N) with j3 2 = — d (mod AN) and consider the set Qd,N,p — { K c ] e 
Q d | a = (mod N), b = (3 (mod 2A^)} on which r (A^) acts. We assume that d is not 
divisible as a discriminant by the square of any prime dividing N. Then the the image 
of the root «q (Q G Qd,N,p) in r (iV)\i3 corresponds to Heegner point and the natural 
map from the quotient Qd,N,p/^o(N) to Qd/T is a bijection. We define a trace t^ N '^(d) 
by t^(d) = T, Q eQ d , N ,p/r (N) Since 3n is the Hauptmodul for r (A^)*, the 

value of t( N 'P'(d) is independent of the choice of (3 and we can simply write v- N \d) instead 
of t( N '@'(d). Zagier described t^ N '(d) as the Fourier coefficient of certain Jacobi form of 
weight 2 and index iV for 2 < N < 6 (see JTSJ Theorem 8). 

Let M^ +1 i 2 (N) be the vector space consisting of nearly holomorphic modular forms 
(holomorphic in and meromorphic at cusps) of half-integral weight k + 1/2 on To(4A^) 
whose n-th Fourier coefficient vanishes unless (— l) k n is congruent to a square modulo AN . 
According to Borcherds' duality theorem (Theorem 3.1 in 0]), the only obstructions to 
finding such forms of weight 1/2 are given by holomorphic vector valued modular forms 



© = {2, 3, 5, 7, 11, 13, 17, 19, 23, 29, 31, 41, 47, 59, 71}. 



■j-i 
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of weight 3/2, which can be identified with elements in (=the space of holomorphic 
Jacobi forms of weight 2 and index N) (see ^T] Theorem 5.1). Let N be a positive integer 
for which the dimension of is zero. Then for every integer d > such that — d is 
congruent to a square modulo AN, we can find a unique modular form f djN G M[^ 2 (N) 
having a Fourier expansion of the form 

fdjf = q- d + 1 £ t A(D,d)q D . 

D>0 

We define a polynomial H d , N (X) by U (X -j* N (a Q )) 1/lP ^. In jEj, from Zagier's 

Q6Qd,N,/3/r (iV) 

trace formula ([TH] Theorem 8) we derived the following product identity: for iV = 2, 3, 5, 6 

oo 

H diN {jUr)) = q- H{d) - Q u ) A * iu2 ' d) « 

u=l 

where H(d) (= jfri) is the Hurwitz-Kronecker class number and A*(D, d) is defined 

to be 2 S ^ D,N ^A(D, d) with s(D,N) the number of distinct prime factors dividing (D,N). 

Given an even lattice M in a real quadratic space of signature (2, n), Borcherds lifting j^j 
gives a multiplicative correspondence between vector valued modular forms F of weight 1 — 
n/2 with values in C[M'/M] (= the group ring of M'/M) and meromorphic modular forms 
on complex varieties (0(2) x 0(n))\0(2, n)/Aut(M, F). Here 0(2, n) is the orthogonal 
group of M(^)R and Aut(M, F) is the subgroup of orthogonal group of M (= Aut(M)) 
leaving the form F stable under the natural action of Aut(M) on M'/M. In this article 
we are mainly concerned with 0(2,1) case. For 0(2, n) (n > 2) case one is referred to 
[3 E] • We take M to be the direct sum of 2-dimensional unimodular Lorentzian lattice and 
1-dimensional lattice generated by a vector of norm 2N, as in Example 5.1 of 4 j. If N — 1, 
each element in M[, 2 (l) has a natural interpretation as a vector valued modular form ([2] 
Lemma 14.2). Let N be a prime p for which r (p)* is of genus zero, i.e. p G &. We 
will interpret a scalar valued modular form / G M{, 2 (p) as a vector valued modular form 
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F with values in C[M'/M]. The Borcherds lifting of F is then a meromorphic modular 
form on T (p)* whose zeros or poles occur only at cusps or imaginary quadratic irrationals 
corresponding to Heegner points. Moreover it has an explicit form of infinite product 
expansion ([3] Theorem 13.3) which allows us to extend (Q) to hold true for all p G &. 
(see (jl6|0 . As a byproduct we can extend Zagier's trace formula to all primes p e & (see 
Corollary 13. fijl . 

Corollary 13.61 gives a description of the coefficient of q 1 in /^jv as the trace of singular 
value of j* N . In [IE] §7 when the level N is equal to 1 and D > 1, Zagier described the D-th 
coefficient of fd,i in terms of the relative trace of singular modulus of discriminant — dD 
from the Hilbert class field of Q(a/— dD) to its real quadratic subfield Q(\/D). In §4 we 
will investigate the analogue of this in higher level cases and construct Borcherds products 
(see Theorem 14. 4|) . 



2. Preliminaries 

2.1. Modular forms of half-integral weight. Here we recall some basic definitions. 
Let & be the group consisting of all pairs (A, ipij)), where A = ( * h d ) G GL^ (K) and ip{r) 
is a complex valued function holomorphic on S) satisfying |V , ( r )| = (det A)~ 1 I a \ct + d] 1 ^ 2 , 
with group law defined by {A, ^i(r))(S, ^(r)) = (AS, ^(Br)^(r)). If / : Sj -> C and 
f = (A-0(t)) G 0, we put /| K]fc+1/2 = fk = ^{r)- 2k - 1 f(AT). Then from definition it 
follows that /l&lga = There is a monomorphism To(4) — > given by A i— > A* : = 

(A,j(4t)), where j(i,r) = {fj (^)~ 1/2 (cr + d) 1 / 2 if A = ( a c b d ). A complex valued 
holomorphic function / on Sj is said to be a modular form of half-integral weight k + 1/2 
on r (4AQ if it satisfies /|^* = / for every A e r (4AQ, and is holomorphic at the cusps. 
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2.2. Jacobi forms. A (holomorphic) Jacobi form of weight k and index N is defined to 
be a holomorphic function <fi : Sj x C — > C satisfying the two transformation laws 

0(^I±*,_LJ) = ( ct + d)V^^(r, z) (V(^)GSL 2 (Z)), 
\ cr + a cr + a J 

0(r, 2 + Ar + /i) = e- 2 ^ AV+2Az V(T, z) (V(A„)eZ 2 ) 
and having a Fourier expansion of the form 

0(r, a) = J] c ( n ' r )^C r (? = e2mT > C = e 2m2 ), (2) 

4JVn-r 2 >0 

where the coefficient c(n, r) depends only on ANn—r 2 and on the residue class of r (mod 2iV) 
([HI Theorem 2.2). In (j2J), if the condition 4Nn — r 2 > is deleted, we obtain a nearly 
holomorphic Jacobi form. 

Let Jj, ^ be the space of nearly holomorphic Jacobi forms of weight k and index N. Let 
J] „ be the ring of all nearly holomorphic Jacobi forms and J ev ^ its even weight subring. 
Then f ev ^ is the free polynomial algebra over M;(r) = C[E A , E 6 , A" 1 ]/^ - E 2 = 1728A) 
on two generators a = 0_2,i(t, z) E Jl 2 ± and b = o ,i(t, z) 6 (see [TT] §9). Let 
iV G {1} U 6 and k = 2. There are Jacobi forms 0d,jv £ 4)v uniquely characterized 
by the requirement that they have Fourier coefficients c(n,r) = B(D,4Nn — r 2 ) which 
depend only on the discriminant r 2 — 4Nn, with B(D,—D) = 1, B(D,d) = if d = 
4iVri — r 2 < 0, 7^ — £) and 5(-D, 0) = —2 or according as D is a square or non-square. 
The uniqueness of (pD,N is obvious since the difference of any two functions satisfying the 
definition of 4>d,n would be an element of J 2 ,n, which is of dimension zero (see ^1] p. 118). 
For the existence the structure theorem enables us to express 4>d,n as a linear combination 
of a^-^i = 0, . . . , N) over Af](r). 

Through the article we adopt the following notations: 

• /3: an element in Z/2iVZ. 
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f": the image of T' in PSL2{ 



• T' Q : ={ 1 eT'\Qo 1 = Q}. 



• When we write Qd,N,/3, (3 is always assumed to satisfy (3 2 = — d (mod AN). 

• e(x): = exp(2nix). 

• ( n : = e(l/n) = exp(2iri/n). 

• s(D,N): the number of prime factors dividing (D,N). 

• U m : the Hecke operator defined by X^ez c ( n )<? n \u m = Y. n &z c(mn)q n . 

• Ek{r): the normalized Eisenstein series of weight k, equal to l—(2k/Bk) Xln>o a k-\{n)q n 
where B& is the fc-th Bernoulli number defined by J2k&z-Bkt k /k\ = t/(e t — 1) and 
<?k-i{n) = E d i" 

ci>0 

3. Vector valued modular forms 

Definition 3.1. Let M be an even lattice of signature (2, n) equipped with a non-degenerate 
quadratic form q(x) = \{x, x). Let M' be the dual lattice of M and C[M'/M] be the group 
ring of M'/M with basis e 7 for each 7 e M'/M. We define a vector valued modular form 
of weight k and of type pu to be a holomorphic function F(r) = J2^eM'/M ^y( r ) e 7 on the 
upper half plane 5} with values in C[M'/M] such that 

/ i7 (r + l) = e(( 7 ,7)/2)^(r) 

-n-2 



hJ-l/r) = — y% VT h y e (-( 7 ,£))/i,( r ) 



^_ 7 ( T ) = (-l)^- 2 /i 7 (r). 

For a fixed positive integer iV, we take M to be the 3 dimensional even lattice of all 
symmetric matrices v — (bc) w ith NA,B,C E Z with the norm (v,v) = — 2iVdet (v). 
The lattice M splits as the direct sum of the 2 dimensional hyperbolic unimodular even 
lattice //i,! w Z ( ^ J ) + Z ( g 5 ) and a lattice generated by ( ° J ) of norm 2N. Thus 
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the dual lattice M' is the set of matrices ( £ g ) with JVA, CeZ, and M'/M can be 
identified with Z/2iVZ by mapping a matrix of M' to the value of B G ^Z/Z « Z/2NZ. 
The group r (iV)* acts on the lattice M as an orthogonal transformation by t> t—> for 
v £ M and X G r (./V)*. Moreover it is not difficult to verify that the special orthogonal 
group of M is T (N)*. 

In the following we will interpret a scalar valued modular form in M{y 2 (iV) as a vector 
valued modular form of weight 1/2 and type pu- For simplicity we will restrict ourselves 
to the case N is a prime p in the set &. Let / = Xmez c ( n )? n e M[, 2 (p). For ft G Z/2pZ, 
we set 

^(r) = 2 S(/3 ' P) " 1 ^ C (^)?" /4P 

n=/3 2 (4p) 

where s(ft,p) = 1 if ft = 0,p (mod 2p) and otherwise. Then clearly we have 

h fi (T + l)=<£hp(T). (3) 

For j prime to 4p, we consider fj = f\ ^ i ^ j (4p)1/4 j lw 4p wh ere W 4p = ( ( 4 ° p V ) , (4p) 1 / 4 v /r «r) . 
By definition fj — f\ // 4pj - _ x \ \ . Let 6 and d be integers satisfying jd — Apb = 1 and 

16p 2 o 



= (?) V (fK 1 - Then Jt holds that ( i 5 )* (( * -£ ) > V>i) = (( $ "o 1 ) , 2v^) • 
Thus /j = f\^ j b 4p _ d ^ ^ = ipj l f (t - ^J, from which it follows that 



/I ((i4).(*)^ l " , * = ,> ' 1/ ( T "^) (4) 



where j 1 denotes the inverse of j in (Z/4pZ)*. The left hand side of (0J is 

(4p)~ 1/4 / (^) \w 4p = (4p)- 1/4 (^c(n)C^" /4p )k 4p = ^p)^ 4 ( £ ] k 4p 



(5) 
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On the other hand, the right hand side of (J3| is 



(6) 



v /3(2p) 



Replacing r by r/4p in (0), (jEJ) and recalling the definition of ipj we obtain the following 
identity: 

£ C^f-l/r) = (f ) ^ ■ £ ^**w. (7) 



/3(2p) 



/3(2p) 



Let i? be a 2p x 2p matrix defined by R = ((2pj ■ To show that J2/3(2 P ) hptp ls 

a vector valued modular form, it is necessary to check that 



hp 

\ ; / 



-l/r) = Vr R 



( k -\ 

hp 

\ ■ / 



T . 



Since /ig = the above identity is equivalent to 



.4 



f h0 \ 



V ; 7 



■l/r) 



V i / 



(r) 



(9) 



for some matrix A with 2p columns of which the first p + 1 ones are linearly independent 
and span the other ones. We take A = [C^J 1<t< (4 ) where ji is the Z-th largest element 

O<0<2p 

in the set { j | 1 < j < 4p and (j, 4p) = 1}- We can check that the rank of A is p+ 1 unless 
p = 2. Moreover from the Gauss quadratic sum identity (jTHj Chapter IV, Section 3) it 
follows thai .47? = I ( ^) . f — ) Clf h 1 ] ■ Now the identity © follows from 



(J7J) except for the case p = 2. 



l<i< v (4p) 
0</3<2p 



TRACES OF SINGULAR VALUES AND BORCHERDS PRODUCTS 9 

/ 1 (8 -1 C8 \ 
/ 1 £3 -1 £3 \ 

Remark 3.2. When p — 2, the matrix A is I x ^1 _ x J J and its rank is 2. If we take 
j = 1, 5 in (J7J), we obtain the following two identities: 

ho (-1/r) + 2C 8 /^i (-1/r) - h 2 (-1/r) = V^(h (r) + 2£ 1 h 1 (T) - h 2 (r)) (10) 
ho (-1/r) - 2Cs^i (-1/r) - h 2 (-1/r) = -v^o(r) - 2Q 1 h 1 (r) - h 2 (r)). (11) 

Thus in order to determine hp (—1/r) in terms of /i 7 (r)'s we need one more identity. We 
consider 

i i 
2 (/U)l(( i o ),V47+T) = g u ),^ )( ( i o )iV37TT) = g /l ( ( i+4, i ),nv^+T) 



^ fl ( IS )*(( l°2 + ^ ;l ( I I )'(( I', 1 



2/ J V 2 



In terms of 5 = (( ° q 1 ) , \/t) and T = (( J } ) , 1) we can rewrite the above as 2(f\u 2 )\sT-*s- 1 
/(l) -/t 1 * 1 )' This yields 

(/WU=i(/©-/(^))Ur.. (12) 

The left hand side of (I12J) can be written as 

(/io(4r) + /> 2 (4r))| 5 = (/i (-4/r) + ^(-^r))^ 1 . 

Meanwhile the right hand side of (|T2"j) turns out to be 

2/>i(4r)| 5T4 = 2(/i 1 (-4/r) v / f" 1 )| T 4 

= 2 ^ v /r74(Mr/4) " ^(r/4))^^ |t* by {EJ and CP 

= ^(/ i0 (r/4) + / i2 (r/4))by ©• 
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Replacing r by 4r we come up with 

ho(-lfr) + h 2 (-l/r) = Q l V^{h G {r) + h 2 (r)). (13) 
Now from ffTT7^> . (fTTjl and (fTTIJ) we can verify (jHJ) in the case p = 2, too. 

Now we will work out Borcherds lifting in 0(2, 1) case. With M as before, we let 
G(M) denote the Grassmannian of M, i.e. the space of all two dimensional positive 
definite subspaces of M(££)R acted on by the orthogonal group 0(2, 1). In our case the 
Grassmannian G(M) can be identified with the upper half plane by mapping r G ft to 
the two dimensional positive definite space spanned by the real and imaginary parts of the 
norm zero vector ( T ^ \ J . Let F = Y2b hptp be a vector valued modular form associated to 
/ = J2nez c ( n ) ( l n e ^i/2 (p)- We write J^nez Cp(n/4p)e{nr /Ap) for the Fourier expansion 
of hp(r). Theorem 13.3 of [H| implies that there is a meromorphic function on G(M) 
that have infinite product expansion (explicitly given by Item 5 in Theorem 13.3 of [Hj) 
with the following properties: 

1. tyf is an automorphic form of weight co(0)/2 for some unitary character of Aut(M, F). 

2. The only zeros or poles of ^ f lie on the divisors A -1 for A G M, A 2 < and are zeros of 
order Vo< I a c x \(x 2 \ 2 /2). 

x\£M' 

We can translate the above in terms of usual modular forms as follows: 

Theorem 3.3. With the same notation as above, we have, 

(i) for some h, 

y f ( T ) = q- h Y[{1~ q n ) c ^ n2 /^\ (here for each n>0, (3 = n (mod 2p) ) 

n>0 

is a meromorphic modular form of weight cq(0) for some character ofTo{p)*. 

(ii) The possible zeros or poles of ^ f occur either at cusps or at imaginary quadratic 
irrationals a e satisfying pAa 2 +Ba+C = with (A, B, C) = 1. Let 5 = B 2 —4pAC < 0. 
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Then the multiplicity of the zero of ^ f at a is given by J2 n >o c p{& n2 I^P) (here for each 
n > 0, f3 is chosen such that (3 2 = Sn 2 (mod 4p)). 

Recall the nearly holomorphic modular form fd, p in Mw 2 (p) with Fourier expansion of 
the form q- d + J2d>i A i D , d)q d . We write 2 fd, P = Enez c{n)q n . By Theorem EQ1 (i). 

oo 

^2/ d , p = q~ h q u ) A * {u24) (for some h) (14) 

u=l 

is a meromorphic modular form of weight for some character of r (p)*. Choose an integer 
f3 (mod 2p) with (3 2 = —d (mod 4p). From Theorem 13.31 (ii) it follows that the zeros of 
^2f dp occur at cvq for each Q e Qd, P ,/3 with multiplicity 



c p (-d/4p) = 2 s ^^~ l c{-d) 



1 <*p\p&p±-p(mo&2p)<*QoW,<£Q dJPif > 

2 <s> p | p ^ (3 = -13 (mod 2p) & Q o W p G Q d , Pi/3 . 



On the other hand, the multiplicity of the zero of jp(r) — jp(ag) at «q is 

|r (p)* Q l = 

From this observation we come up with 



\r (p) Q \, if QoW p ^Q (modr (p)); 
2\r (p) Q \, ifQoW p = Q (mod r (p)). 



II (£W -£(««)) lroWo1 (15) 

QeS d ,p,/3/r (p) 
Comparing (|T4*jl with (|T5|) we get 

00 i 
«=i QeQd, P ,p/ro(p) 

where H Py p(d) = J2Q<=Q dp /r o ( P ) \r ( P ) Q \ - Note that ^ ^ * s n °t divisible as a discriminant 
by p 2 , then \Qd,p,fi/T Q (p)\ = |Qd/T| and |Fq(p)q| = \Tq\. Therefore in this case H Pt p(d) is 
none other than H(d). 
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Example 3.4. Let p = 2, d = 16 and /3 = (mod 4). A set of representatives for 
Qi6,2,o/r (2) is given by Q l = [4, -4, 2], Q 2 = [2, 0, 2] and Q 3 = [4, 0, 1]. We observe that 
|f o(2)qJ = 2 if i — 1 and 1 otherwise. Up to modulo r (2), the involution W 2 fixes Qi and 
interchanges Q 2 with Q 3 . Thus, by flU, # 2/l62 = (j*(r) - j* (a Ql )) 1/2 (j 2 *(r) - 3* 2 {a Q2 )f. 

Let / = Ed £ z A(D)q D G M{ /2 (p). As before , we set hp(r) = 2 s( ^- 1 E A(D)q D / 4 P 

D=0 2 (4p) 

for each (3 G Z/2pZ. By © 



^(-l/r) = -^g- £ e(-/3i/2p)^(r). 



J (2p) 



Let G J 2p . The Fourier coefficient c(n, r) of g n C r in depends only on the discriminant 
r 2 — 4pn and therefore we can write c(n,r) = B(Apn — r 2 ). For // G Z/2pZ, we set 
^ = E«fe-/r»(4p) B{d)q d /^. The formula (9) in jUJ §5 says 



K{-1/t) = e(fik/2p)h k (r). 
V2P k (ap) 

Let g = Edez B(d)q d with S(cf) defined to be zero unless — d is a square modulo 4p. From 
definition it holds that / = E/? (2p)^ l p{^P T ) an d 9 — E M (2 P ) 2 s< - At ' p ^~ 1 /i M (4pr). Moreover 
Cf#)k P = Ei ( 2 p)(^i)( r )- Thus CfsOkpO+i) = CffiOkpO) and 

(/p)|^(-l/r)= £(a«)(-l/r) = ^ £ e{-ij/2p)e{ik/2p){hfh k ){r) 

i (2p) P (2p) 

r 2 



2= E £e(*x-j+*)/^)(v*)(T) 

P j,fc (2p) i (2p) 



2p, ii j = k (mod 2p) 



r2 £ ( h j h j)( T ) since £ e ( i ( - ^ + fc )/ 2 P) : 

j ( 2 p) « (2p) | 0, otherwise 
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(fg)\u 4p is then invariant under the action of 6X2 (Z) with a pole only at oo and of weight 
2. Thus {fg)\u4 P can be written as the derivative of some polynomial in j. In particular the 
constant term of the g-expansion of fg vanishes. Applying this to / = f^ v and 4> = 4>D,p 
gives rise to the following lemma: 

Lemma 3.5. Let d = Apn — r 2 for some integers n and r. Let A(D, d) (resp. B(D, d) )be 
the coefficient of q D (resp. q n ( r ) in f^ v G M\j 2 [p) (resp. 4>d, p £ Ji,p)- Then A(D,d) = 
—B(D, d). 

Corollary 3.6. Let p be a prime for which T (p)* is of genus zero. For each natural number 
d which is congruent to a square modulo 4p, let t^(d) = X]ges d g/v (p) \r (p)Q\ ip( a ^ ' 
We also put ^(-1) = -1, t^(0) = 2 and &\d) = for d < -1. Then the series 
r t^(4pn — r 2 )q n ( r becomes a nearly holomorphic Jacobi form of weight 2 and index p. 

Proof. In 116)) if we compare the g-expansions on both sides, then we obtain t^ p \d) = 
A*(l, d) = A(l, d) which is equal to —B(l, d) by Lemma Now the series ^ n r t^(4pn— 
r 2 )q n ( r coincides with —<f>i }P . □ 



4. Twisted traces of singular values 

Let D and — d be a positive and a negative discriminant, respectively. For simplicity we 
suppose them to be fundamental and coprime. Let K = Q(\/—Dd). Let p 1 , . . . ,p r be odd 
primes dividing Dd and put p* = (— l)^ i_1 )' 2 pj for i = 1, . . . ,r. By class field theory the 
genus field M of K is expressed as K(^/p^, . . . , y/p$) and is contained in the Hilbert class 
field H of K (see JE] Theorem 6.1). We have obvious inclusion iV = K{\fD) C M C H . 
The genus character x — XD-d assigns to any quadratic form Q of discriminant —dD a 
value ±1 defined by x{Q) = (^f) = (~^r) wn ere q is any prime represented by Q and not 
dividing Dd. This is independent of the choice of q. We further assume D and —d to be 
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congruent to a square modulo 4p. We define the "twisted trace" t^- p >{D,d) by 

&\D,d)= x(Q)f P (a Q )- 

Q&QdD, P ,0/^o(p) 

Proposition 4.1. (i) The definition of tw(D,d) is independent of the choice of (3. 
(ii) Let p be a prime such that p — 1 divides 24. Then -^t^ p \D, d) is a rational integer. 

Proof, (i) Since W p induces a bijection between QdD, P ,/3/^o(p) and QdD, P -/3/^o(p), it is 
enough to show that x(Q ° W P ) = x{Q) and 3p( a QoW p ) = jp(^ Q ) for each Q G QdD, P ,p- 
The latter is clear since j* is the Hauptmodul for Tq(p)*. The invariance of \ under W p 
follows from Proposition 1 in p. 508 of [T2j . 

(ii) It is well-known that j{ao) is an algebraic integer. By [2] Remark 1.5.3 and Appendix 
1 there is a modular relation between j and j* which allows j* to be integral over Z[j]. 
Therefore jp(o>Q) is an algebraic integer, too. Let j QiP be the Hauptmodul for T (p). Then 
j* can be written as jo,p( r ) + 3o, p (W p t) up to some constant (g Z). By [7] Theorem 3.7.5, 
Jo,p("q) (resp. jo,p(Wp a Q)) generates Hilbert class field H of K so that j*(«Q) belongs 
to iJ. The set of forms Q with = +1 is identified with Gal(if/iV). Therefore the 

sum Yli X (Q)=+i j P ( a o) i s ^ ne trace of the algebraic integer ] p (oiq) from H to N. Since this 
number is invariant under the complex conjugation, it belongs to Q(\/D). If we write 
this number as A = |(a + b\/~D) with a, 5 G Z, then the sum over all 3 p {oiq) is equal to 
^H/K(jp(a Q )) = Tr N/K o Tr H / N (j*(a Q )) = Tr N/K (X) = a. Hence the sum t (p) (L>,<i) is 
equal to —a + 2A = b\f~D. □ 

Here are some numerical examples with p = 2 and p = 3: 
^t( 2 )(17,4) = ^=(j 2 * (a [18)2il] ) +j* (a [2j2 , 9] ) - j 2 * (a [6 ,-2, 3 ]) - j 2 * ("[6,2,3])) = -204800, 

^(8,7) = ^(j 2 * (a[14,0,l]) + J2 ("[2,0,7]) -3*2 ("[6,4,3]) ~ J 2 ("[10,8,3])) = 90112, 

and 

-^t( 3 )(13,3) = -^(i 3 * (a [12 , 3j l]) + j 3 * ("[3,3,4]) -J3 ("[6,3,2]) " 3*3 ("[15,9,2])) = "378, 
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^=t( 3 )(13,8) = ^(j* (a [27l 2,l]) ~3*3 ("[21,8,2]) +3* 3 (a[3,2,9]) +f 3 ("[9,2,3]) ~ 3*3 ("[6,-4,5]) - 

3*3 («[15,14,5])) =-11968, 

^t( 3 )(21,8) = ^(j* (a [42 , 0il] ) -j* (a [21 , , 2] ) + 3*3 («[3,o,u]) - J 3 * ("[6,0,7])) = 342144. 

We want to express these traces as the coefficients of fd, p - As explained in the Appendix 
of [IB], fd, P can be found by making use of "Rankin-Cohen bracket" [ , ] n . Let /(r) and 
g(r) denote two modular forms of weight k and I on some group f cT. We denote by D 
the differential operator ^--^ = q-^ and use /', /", . . . , / (n) instead of Df, D 2 f, . . . , D n f. 
The n-th Rankin-Cohen bracket of / and g is defined by the formula 

^-^ (n + k—l\ (n + l — l\ 

[f,9}n(r)= Yl (-!) r f {r \r)g^(r). 

r+s=n \ S J \ T I 

By jH] §7 (or [T7j §1) [/, g] n ij) is a modular form of weight k + 1 + 2n on T'. Let us consider 
the construction of fd> p in the cases p = 2 and p = 3: 

p = 2: Let = £„ e z g" 2 , u = {[9, Si O (8r)]i/A(8r)+21120)/(-4O) and*; = ([0, £ 8 (8r)] 2 /A(8r)- 
1152O0)/72. Then it follows that 

/ 42 = (u- u )/12 = g- 4 -52g + 272g 4 + 2600g 8 -8244g 9 + 15300g 12 + 71552g 16 -204800g 17 + 
282880g 20 + • • ■ , 

/ 72 = (4u - u)/3 = <T 7 - 23g - 2048g 4 + 45056g 8 + 252g 9 - 516096g 12 + 4145152g 16 - 
1771g 17 - 26378240g 20 + • • • 

p = 3: Let u = ([0, E 10 (12r)] 1 /A(12r) + 15840)/(-2O), v = ([0, £ 8 (12t)] 2 /A(12t) - 
2592O0)/72 and w = ([0, £ 6 (12t)] 3 /A(12t) + 27216O0)/(-112). Then we obtain that 
/ 3j3 = (4u - 5w + w)/360 = q- 3 - Uq + 40g 4 - 78g 9 + 168g 12 - 378g 13 + 688g 16 - 897g 21 • ■ ■ , 
/ 8 3 = (_g M + io v - W )/Q0 = g -8 _ 34 g _ i88g 4 + 2430g 9 + 8262g 12 - 11968g 13 - 34936g 16 + 
171072g 21 --- , 

f U3 = (36m-13w+w)/24 = g- n +22g-552g 4 -11178g 9 +48600g 12 + 76175g 13 -269744g 16 - 
1782891g 21 • • • . 
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Comparing these coefficients with the examples of twisted traces t^(Z?, d) we are led to 
the following result which can be proved in a way analogous to the proof of [18] Theorem 
6: 

—=t^\D, d) = A*(D, d) = -B*(D, d) (17) 

with A*(D,d) = 2< D ^A(D ) d) and B*(D,d) = 2< D ^B{D,d). 
Now we will derive certain product identities from (j!7jl . 

Lemma 4.2. For i > and m coprime to p, 

4>p 2i m 2 D,l\v p = P4>p 2i + 2 m 2 D,p + 4>p 2i m 2 D,p- 

Here V p is the Hecke operator on Jacobi forms defined by the formula (2) in jllj . 

Proof. According to [11] Theorem 4.1, the operator V p maps J\ \ to .T 2p . From the formula 
(7) in P], P-43, we find that 



the coefficient of q n ( r in 0p2i m 2 D1 |y p = < 



p, if Apn — r 2 = —p 2t+2 m 2 D 
1, if Apn — r 2 = —p 2t m 2 D 
0, if Apn — r 2 < 0, ^ —p 2l+2 m 2 D, —p 2l m 2 D. 

From these observations and the uniqueness of <pD,p, the lemma immediately follows. □ 
Let t = j*. For each positive integer m, we define 



t$(D,d)= x{Q)t m {a Q ) 
QeQdD, P ,p/ro{p) 

where t m is a unique polynomial of t such that t m = q~ m (mod gC[[g]]). We can use Hecke 
operators in integral and half-integral weight to get the following lemma whose proof is 
similar to that of formulas in p. 13 of 
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Lemma 4.3. Let I be a positive integer coprime to p and d = 4pn — r 2 . Then 
(i) -±=t\ p \D,d) = -coefficient of q n ( r in 2 s (^)0 Ap | T;) 

(H) (f>D lP \ Tl = £„|j (rj) Hv*D#- 
We claim that for d = 4pn — r 2 , 




Let J = j — 744 and J m be the unique polynomial such that J m = q~ m (mod gC[[g]]). 
By "expansion formula" p. 14 or P p. 319) we come up with ti p k+i(r) = Ji p k(pr) + 

Ji p k{r) — t lp k{r) (for k > 0) and therefore 

Y x(Q)ti p k+i(a Q ) 

Q&QdD, P ,0/^o{p) 

x(Q)(Ji p *(pt) + Ji p k(r))\ T=aQ - Y x(Q)ti p k(a Q ). (19) 

Q&QdD, P ,0/To(p) QeQ dD , P:0 /r o (p) 

The map which sends [a, b, c] G QdD, P ,/3 to [a/p, b, cp] G QdD induces a bijection between 
QdD,p,p/^o{p) and Qdo/r. And the natural map from QdD, P> p/^oip) to Q^d/T also gives 
a bijection. Theses maps preserve the values of x an d (fT9"j) is rewritten as 

x(Q)ti p k+i(a Q ) = 2 x(Q)^(o!q)- X] x(Q)ti p k(a Q ), 

QeQ dD , p ,i3/r (j>) QeQ dD /r QeQ. dD ,p,p/To{p) 

which yields 

t^(D,d) = 2t. ( 2p,d) - &l(D,d) for fc > 0. 
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In (I18|) we write m = lp k with (l,p) = 1. We use induction on k to prove the claim. If 
k = 0, the claim (fTHj) follows from Lemma f4. 31 Now we assume the claim for k. 



in 2(</>n i It ,/)lv.. ^ 



coefficient of q n ( r in 2(0 D ,i| Tjp J|y p - -^tJJ(D,d) by [IB] formula (25), Theorem 5-(iii) 



k ( D \ 1 

-coefficient of q n ( r in 2(^^z/p l ( ^/^-i j <^v<Ai)k ~ ^ t !?( jD ' rf ) 



i=0 v\l 

by PH] P-13 and Theorem 5- (iii) 
— coefficient of q n ( r in [2 ^ ^ vp l ( — y J (p(f)„ 2p 2i+2 D>p + (j) v 2 p 2i D)P ) 

i=0 u\l ^ ' ^ ' 

by Lemma 14.21 and induction hypothesis 
-coefficient of g»C in E 2 ^ ( (i/^+i-* ) + £ ^ ) 

since ( — ] = or 1, and 2 s{D < p) = 1 or 2. 



Let 2 G .f). Note that — t m (z) can be viewed as the coefficient of g m -term in — logg — 
log(t(r) - t{z)) (see [IE]). Thus logg- 1 - £ m>0 i t m{z)q m = log(t(r) - *(*))• Taking 
exponential on both sides, we get 



g x exp( 

14 — ' m 

m>0 



y^-t m (z)q m ) = t(r)-t(z). (20) 
By the claim (|18|). we obtain 

^tS(Ad) = -£« (^) *VAd). (21) 
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From (HU) and 023} it follows that 

oo 

n (t(r) - f (oq))*«» = exp(- £ i$(D, d)q m /m) 
Q£QdD, P ,i3/ro(p) m=1 

= exp^^T J> ( —J 5VA d) g -/m) = exp(^£ E u ( d ^VAd)^) 

ni=l u|m m=l it=l ^ ' 



00 / n\ 00 

exp(^(-5*( M 2 J D,d))(- £ - E^TH) 

m=1 0<n<D ^ ' m=l 

by the Gauss sum identity ( — j — ^ \ — )Cd 
exp(f>VA^) (^)log(l-CS^))- 

u=l 0<n<D ^ ' 



Now the following theorem is immediate. 

Theorem 4.4. Let D > 1 and — d < be coprime fundamental discriminants and con- 
gruent to a square modulo Ap. We define H D ,dA x ) = Y\.Q&Q dD ^ p /v Q ( P )( x ~ f P ( a Q)) x(Q) ■ 
Then 

00 

u=l 

where A*(D,d) = 2< D ^A(D,d) and P D (t) = \\ Q<n<D {l - CB*)^- 

Example 4.5. Let us consider the case p = 3 and D = 13, d = 3. For (3 = 1 (mod 6), 
a set of representatives for 639,3, i/r (3) is given by {[12, 3, 1], [3, 3, 4], [6, 3, 2], [15, 9, 2]}. 
Meanwhile the g-expansion of ^3,3 is 

<T 3 -14g+40g 4 -78g 9 +168g 12 -378g 13 +688g 16 +- • -+133056g 52 +- ■ -+(-30650256)g 117 +- ■ ■ . 
Theorem 14.41 yields the following product formula: 

(jf(T) ~js ("[12,3,1])) (jKr) - & ("[3,3,4])) _ p , . 378p , 2 \ViaOBBp, q 3x2(-30650256) 



-jl ("[6,3,2])) (j 3 *( r ) -3*3 ("[15,9,2])) 
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